WYC:dks 1/10/05 EWG-145 US 



PATENT 



Tn the Claims: 

1 . (Currently Amended) The A method of generating a high resolution image from a 
scries set of nearly identical low resolution images, each of which con t ain contains a reference 
signal, the method comprising: by 

readin g identifying said reference signal from in each of said low resolution images to 
de t ermine t h e ali g nmen t of t he pi T els i n H i e ima ge relate the locations of said images 

identifying a first group of said low resolution images having red image information 
at a location most closely aligned with a first position in said high resolution image; 

identifying a second, different^ group of said low resolution images having red image 
information at a location most closely aligned with a second, different, position in said high 
resolution image; 

processing the red image information from said first group of images to generate 
red data for the first position in said high resolution image; and 

processing the red image information from said second group of images to generate 
red data for the second position in said sel e c t in g t h e ima ge s whose pirelx are w it hin a 
sp e cified to l er an c e from s p ecifi e d p o si t i o ns, 

c o mbinin g th e selec te d ima g es to g e n er a te a high resolution image. 

2. (Currently Amended) The method recited in claim 1 wherein the ali g nm e n t is 
de te rmined r ela t iv e t o t he first and second positions correspond to positions in a Bayer 
square. 

3. (Currently Amended) The method in claim 1 wherein the pixels in said low resolution 
images have colors in accordance with a Bayer square. 

4. (Currently Amended) The method recited in claim 1 wherein said reference signal is 
comprises a watermark signal. 
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5. (Currently Amended) The me + hnd reri te d in Ha i m 1 A method nf generating a 
high resolution image from a series of nearly identical low resolution images, each of which 
contains a reference signal, the method comprising: 

reading said reference signal from each of said low resolution images to determine 
+ht> alignment of pivels in the image, 

selecting images whose pixels are within a specified tolerance from specified 
positions, and 

combining the selected images to generate a high resolution image, 
wherein said reference signal is comprises a watermark grid signal. 

6. (Currently Amended) A method of generating a high resolution images image from a 
plurality of low resolution images whose pixel values are in [a] Bayer squar e , squares, the 
method comprising 

determining which identifying a first group of said low resolution images thai align 
with each a first pixel hole position of a Bayer square, 

identifying a second, different, group of said low resolution images that align with a 
second, different, pixel hole position of the Bayer square, and 

combining said mul t iple determined low resolution images to fill in the holes in a Bayer 

square. 

7. (Currently Amended) The method in claim 6 wherein the pixels values in multiple 
images which are aligned with each pixel position are averaged and the averaged images [a] are 
combined to fill the holes in a Bayer square. 

8. (Currently Amended) A method q£ c o mbining a generating a high resolution image 
from a plurality of low resolution images , the method comprising, 

pr o ducin g a physical ima g e which includ e s a hidden ref e r e nc e si g nal, 
capturing a plurality of low resolution electronic images of said physical imag e a 
snhjeot, the subject defining a hidden reference signa^ 
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using said reference signal to align determine alignment of a plurality of said low 
resolution images, and 

combining data from some hut not all of said aligned low resolution images into a high 
resolution image. 

9. (Original) The method recited in claim 8 wherein said low resolution images are 
aligned in accordance with the holes in a Bayer square. 

10. (Currently Amended) The method recited in claim 8 wherein a plurality of low 
resolution images are captured and only those low resolution images which align to within a 
specified tolerance with the holes in a Bayer square are used to form said composite image. 

1 1 . (Currently Amended) A system for generating a high resolution image from a series 
of nearly identical relatively low resolution images , the system including! 

a watermark reading program for reading a watermark grid signal from each of said low 
resolution images to determine the alignment of the pixels in the low resolution images relative 
to the positions in a Bayer square, 

an image selection program for selecting the low resolution images whose pixels are 
within a specified tolerance from each position in the Bayer square, and 

an image combination program for combining the selected low resolution images to 
generate a high resolution image. 

12. (Currently Amended) A system for generating a high resolution images from a 
plurality of relatively low resolution images whose pixel values are in a Bayer square 
configuration, the system comprising! 

means for determining which of said images align with each pixel position of a Bayer 
square to within a specified tolerance, and 

means for combining multiple aligned low resolution images to fill in the holes in a 
Bayer square. 
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13-15. (Canceled) 

16. (Currently Amended) The me t ho d recited in c la i m 13 A method of generating a 
high resolu tion image from a plurality of low resolution images T the method comprising. 

capturing a p lurality of low resolution electronic images of a subject, the snhject 
defining a hidden reference signal. 

using said refe rence signal to determine alignment of a plurality of said low 
resolution images, and 

combining at least some of said low resolution images into a high resolution image, 

wherein said reference signal is comprises a watermark grid signal. 

17. (Currently Amended) The A method of generating a high resolution image from a 
plurality of low resolution images, the method comprisin g t h e s te ps o f, i 

capturing a series of low resolution images, each of which con t ain contains a reference 

signal, 

reading said reference signal from each of said low resolution images, 
aligning said low resolution images in accordance t he loca t ion o f with said reference 
signal, and 

combining said aligned low resolution images into a high resolution image; 
wherein said reference signal comprises a watermark signal. 

18. (Canceled) 

19. (Currently Amended) Th e me t ho d r e ci t ed i n claim 17 A method of generating a 
high resolution image from a plurality of low resolution images, the method comprising: 

capturing a series of low resolution images, each of which contains a reference 

sign ah 

reading said reference signal from each of said low resolution images, 
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aligning said low resolution images in accordance with said reference signal, and 
cnmhining at least some of said aligned low resolution images into a high resolution 

image, 

wherein said reference signal is comprises a watermark grid signal. 

20. (Currently Amended) The A method of aligning multiple low resolution images to 
form a high resolution image wherein both a hidden reference signal embedded in the low 
resolution images and visible image content are used to align said images. 

21. (New) A method comprising: 

capturing first and second frames of similar image data using a common 2D image sensor 
that is subject to slight movement between frames, said sensor comprising a geometrical pattern 
of sensor elements, each element sensing light of one of at least first or second colors, wherein 
certain locations in said 2D sensor do not sense light of the first color, resulting in unknown first 
color information at various locations in the frames of image data captured by said sensor; 

determining position information relating position of the first image frame to the second 
image frame; and 

generating a composite image frame in which said unknown first color information at one 
of said various locations in the first frame of image data is mitigated by reference to first color 
information from the second image frame that is determined to correspond to said one location. 

22. (New) The method of claim 21 wherein said unknown color information in the first 
frame is thereby estimated without resort to interpolation. 

23. (New) The method of claim 21 in which said determining comprises detecting 
hidden information in said first and second image frames. 

24. (New) The method of claim 21 in which said determining includes correlating with a 
pattern in said first and second image frames. 
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25. (New) The method of claim 21 in which said determining makes reference to 
fiducial markings. 

26. (New) The method of claim 21 wherein said geometrical pattern comprises a regular 

pattern. 

27. (New) The method of claim 26 wherein said geometrical pattern comprises a Bayer 

pattern. 

28. (New) A method comprising: 

capturing a first frame of image data using a 2D sensor, and capturing a second frame of 
image data using said same 2D sensor; 

sensing a hidden watermark signal, useful in determining image rotation and scaling, in 
each of said frames of image data; and 

by reference to said sensed hidden watermark signal, combining data from said first and 
second frames to produce an enhanced frame of image data. 

29. (New) The method of claim 1 wherein none of the low resolution images in the first 
group of images is included in the second group of images. 

30. (New) A method of generating a high resolution image from a set of nearly identical 
low resolution images, each of which contains a marker signal, the method comprising: 

identifying said marker signal in each of said low resolution images to relate locations of 
said images, 

identifying a first group of said low resolution images having image information of a first 
primary color at a location most closely aligned with a first position in said high resolution 
image; 

identifying a second group of said low resolution images having image information of a 
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second, different, primary color at a location most closely aligned with said first position in said 
high resolution image; 

processing the image information of the first primary color from said first group of 
images to generate data of said first primary color for the first position in said high resolution 
image; and 

processing the image information of the second primary color from said second group of 
images to generate data of said second primary color for said first position in said high resolution 
image. 

3 1 . (New) The method of claim 30 wherein none of the low resolution images in the 
first group of images is included in the second group of images. 

32. (New) The method of claim 30 wherein at least one of said low resolution images is 
included in neither said first nor second groups. 
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